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Abstract 

A new understanding of the notion of regularizer is proposed. It is argued that 
this new notion is more realistic than the old one and better fits the practical 
computational needs. An example of the regularizer in the new sense is given. A 
method for constructing regularizers in the new sense is proposed and justified. 



1 Introduction 

Let 

A(u)=g, (1.1) 

where A : X — > Y is a closed, possibly nonlinear, map from a Banach space X into a 
Banach space Y . Problem (jl.lj) is called ill-posed if A is not a homeomorphism of X onto 
Y, that is, either equation does not have a solution, or the solution is non-unique, or 
the solution does not depend on g continuously. Let us assume that (jl.lj) has a solution u 
and this solution is unique but A~ l is not continuous. Given noisy data g$, \\g$ — g\\ < 5, 
one wants to construct a stable approximation ug of the solution u, \\ug — u\\ —>■ as 
5 — > 0. This is often done with the help of a regularizer. Traditionally (see, e.g., [2]) one 
calls a family of operators Rh a regularizer for problem (jl.lj) if: 

a) RhA(u) — > u as h — > oo for any u G D(A), 

b) Rhgs is denned for any g§ £ Y and there exists h(5) —>■ as 5 — > such that 

11^(5)^5 - w|| -> as 5 -> 0, (*) 

where m solves (jl.lj) . 

In this definition w is fixed and (J*j) must hold for any gg G -B(^, 5) := : — g\\ < 5}. 

*key words: ill-posed problems, regularizer, stable numerical differentiation, new notion of regularizer 
tAMS subject classification: 47A52, 65F22, 65J20 



In practice one does not know the solution u. The only available information is 
a family gg and some priori information about the solution u. This information very 
often consists of the knowledge that u G K, where K, is a compactum in X. Thus 
u G Sg '■— {v : ||v4(t>) — < 5, v G /C}. We assume that the operator A is known 
exactly, and we always assume that gg G B(g, S), where g = A{u). 

It is natural to call a family of operators R(S) a regularizer (in the new sense) if 

sup \\R(6)g s - v\\ < rj(5) -»■ as 5 -> 0. (1.2) 

There is a crucial difference between our definition (jl.2|) and the standard definition 
in « is fixed, while in (J1.2)) t> is any element of Sg and the supremum, over all such v, 
of the norm in (|1.2j) must go to zero as 5 — > 0. 

The new definition is more realistic and fits more computational needs because not 
only the solution u to (jl.lj) satisfies the inequality — gg\\ < 5, but many v satisfy 

such an inequality \\Av — gg\\ < 5, v G /C, and the data gg may correspond, in fact, to 
any v G Sg, and not only to the solution of equation (1.1). Therefore it is more natural 
to use definition (jl.2|) than (jsj). 

Our aim is to illustrate the practical difference in these two definitions by an example, 
and to construct regularizer in the sense (|1.2}1 for problem (|l.lj) under the following 
assumptions: 

Al) A : X — >• Y is a closed, possibly nonlinear, injective map, g G 7Z(A), 
and 

A2) (f) : D(4>) ->■ [0, oo), <f>(u) > if u ^ 0, domain D(<f>) C D(A), the set /C = £ c := : 
0(v) < c} is compact in X and contains a sequence v n — > f , and 0(v) < liminfn^oo (f>(v n ). 

The last inequality holds if is lower semicontinuous. Any Hilbert space norm and 
norms in reflexive Banach spaces have this property. 

Examples in which assumptions Al) and A2) are satisfied are numerous. 
Example 1. A is a linear injective compact operator, g G 11(A), <p(v) is a norm on 
X± C X, where X\ is densely imbedded in X, the embedding i : X\ — ► X is compact, 
and </>(i>) is lower semicontinuous. 

Example 2. A is a nonlinear injective continuous operator g G 7£(^4), A" 1 is not 
continuous, is as in Example 1. 

Example 3. A is linear, injective, densely defined, closed operator, g G 1Z(A), A' 1 is 
unbounded, <p is as i n Example 1, Jj C -D(^4)- 

In section 2 it is shown that a regularizer in the sense Q may be not a regularizer in 
the sense (I1.2J1 . In section 3 a theoretical construction of a regularizer in the sense (jl.2j) 
is given. 

2 Example: stable numerical differentiation. 

Here we use the results from |3] - [TU] . 
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Consider stable numerical differentiation of noisy data. The problem is: 

Au:= / u(s)ds = g(x), g(0) = 0, < x < 1. (2.1) 



The data are: g$ and M a , where \\g$ — g\\ < 5, the norm is L°°(0, 1) norm, and ||u|| a < M a , 
a > 0. The norm 

\u(x) — u(y) I 

||u|| a := sup — : : h sup \u(x)\ if < a < 1, 

x, y e[o,i] \ x ~ y\ a 0<x<l 



x^y 

\u\\ a := sup (|u(x)| + \u'(x)\) + sup ^~t~~~ ZJiMl i < a < 2. 

0<x<l x,ye[0,l] \X-y\ a 1 

x^y 



If a > 1, then we define 



fl( ^ 4 := ^ Q < s < Wj (2 2) 

-9s(x- 
h(8) 



gs (x)- 9s (x-h(8)) ^ l-h(5)<X<l, 



where 



h(5) = c a 5- % (2.3) 

and c a is a constant given explicitly (cf [3]). 

We prove that ()2.2|) is a regularizer for (j2.1j) in the sense (jl.2|) . and /C := {f : ||v|| a < 
M a , a > 1}. In this example we do not use lower semicontinuity of the norm (p(v) and 
do not define (p. 

Let Ss, a '■= {v : 11^ — gs\\ < S, \\v\\ a < M a }. To prove that ()2.2j) - (j2.3|) is a regularizer 
in the sense (II. 2J) we use the estimate 

r 

sup \\R(S)g s - v\\ < sup {\\R(5)(g s - Av)\\ + \\R(5)Av - v\\} < -— + M a h a -\5) < 
< c^ 1 "" := rj(S) -> as 5 -> 0. 

(2.4) 

Thus we have proved that ()2.2j) - ()2.3|) is a regularizer in the sense (jl.2j) . 

If a = 1, and Mi < oo, then one can prove that there is no regularizer for problem 
(|2.1j) in the sense ()1.2j) even if the regularizer is sought in the set of all operators, including 
nonlinear ones. More precisely, it is proved in j3] (see also [7j) that 

inf sup \\R(S)gs — v\\ > c > 0, 

where c > is a constant independent of S and the infimum is taken over all operators 
R(S) acting from L°°(0, 1) into L°°(0, 1), including nonlinear ones. On the other hand, 
if a = 1 and M\ < oo, then a regularizer in the sense Q does exist, but the rate of 
convergence in (*) may be as slow as one wishes, if u(x) is chosen suitably jU], [TU] . 
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3 Construction of a regularizer in the sense (11.21) 



Assuming Al) and A2) (see Section 1) throughout this Section, let us construct a reg- 
ularizer for in the sense (jl.2|) . We use the ideas from 10J . Define F§(v) : = 
|| Av — gs\\ + 5<f>(v) and consider the minimization problem of finding the infimum m(5) 
of the functional Fg(v) on a set S$, defined below: 

F s (v) = inf := m{8), v G S s := {v : \\Av - g s \\ < 5, <f>(v) < c}, (3.1) 

so that /C = /C c := {v : 0(i>) < c}. The constant c > can be chosen arbitrary large and 
fixed at the beginning of the argument, and then one can choose a smaller constant c\, 
specified below. Since Fg(u) = 5 + 5<p(u) := ci5, c\ :— 1 + <f>(u), where u solves one 
concludes that 

m(8) < ci8. (3.2) 

Let Vj be a minimizing sequence, such that F$(vj) < 2m{$). Then 4>{vj) < 2c\. By 
assumption A2), as j — > oo, one has: 

Vj v s , (j){y s ) < 2c x . (3.3) 

Take 5 = 5 m ^ and denote vs m := w m . Then ()3.3|) and assumption A2) imply existence 
of a subsequence, denoted again w m , such that: 

w m -> uj, -> A(tw), ||i(«;) - c/|| = 0. (3.4) 

Thus A{w) = g and, since A is injective, w = u, where u is the unique solution to (jl.ljl . 
Define now R(S)gs by the formula R(8)gs '■= vs- 

Theorem 3.1. i?(<5) zs a regularizer for problem (11.1)1 m t/ie sense (ll.2j) 

Proof. Assume the contrary: 

sup \\R(5)gs — v || = sup — v\\ > 7 > 0, (3.5) 

where 7 > is a constant independent of <5. Since <fi(vs) < 2ci by ()3.3|) . and 0(v) < c, one 
can choose convergent in X sequences w m := f5 m — > w, 5 m — > 0, and v m — > v, such that 
ll^m — v m \\ > ~, \\w — v\\ > ^, and A{w) = g, A(v) = g. Therefore, by the injectivity of 
A, w = v = u, and one gets a contradiction with the inequality \\w — v\\ > ^ > 0. This 
contradiction proves Theorem 3.1. 

Note that the conclusions A(w) = g and A(v) = g follow from the inequalities || ^(i^) — 
g^H < 8 and — <7<s|| < 5 after passing to the limit 5^0, using assumption A2). □ 

Remark 3.2. Our argument is closely related to a generalization of a classical result |IJ/ 
which says that an injective and continuous map of a compactum in a Banach space has 
continuous inverse. The generalization of this result, given in f '(f/ ( Chapter 5, Section 
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6, Lemma 2), says that the same conclusion holds if A is an infective and closed map. 
This generalization, in other words, claims that if A is an infective and closed map of 
a compactum K, in a Banach space into a Banach space, then the modulus of continuity 
io{8) of the inverse operator A~ l on the set A(JC) tends to zero: 

sup \\v — w\\ := co(5) —>■ as 5 — > 0. 

\\Av—Aw\\<8 

Therefore, in our proof of Theorem 3.1, one has sup weS \\v§ — — > as 5 — > 0. 

Indeed, v G S$ and v$ G S$, so \\A(v) — gs\\ < 5 and \\A(v$) — gs\\ < 3. Thus 
\\A(v) — A(vs)\\ < 25. Since v$ and v belong to a compactum )C Cl := {v : (j)(v) < 2ci} ; 
Theorem 3.1 follows from the property cj(6) —>■ as 5 — > 0. 

Remark 3.3. H^e /ia^e assumed that A is injective, that is, equation /ias at most 
one solution. This assumption can be relaxed: one may assume that u solves and 
taere is an r > 0, such that in the ball B(u,r) := {v : ||i> — u|| < r} tae solution u is 
unique, but globally may have many solutions. Our arguments remain valid if the 

compactum K := {v : <p(v) < c, v & B(u,r)}. 

One may drop the injectivity of A assumption in Al) in Section 1. In this case (3.4) 
yields w G U, where U := {w : A{w) = g}. Thus, lim^o p(R(d)96i U) = 0, where p(w, U) 
is the distance from an element w to the set U . 

In applications, when a physical problem is reduced to equation (1.1), one wants to 
have a unique solution to (1.1). If the solution is non-unique, that is, U contains more 
than one element, then one wants to impose additional conditions which select a unique 
solution in the set U, thus making the operator A injective. 
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